Incoherence and enhanced magnetic quantum oscillations in the mixed state of a 

layered organic superconductor 
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We present a theory which is able to explain enhanced magnetic quantum-oscillation amplitudes 
in the superconducting state of a layered metal with incoherent electronic transport across the layers. 
The incoherence acts through the deformation of the layer- stacking factor which becomes complex 
and decreases the total scattering rate in the mixed state. This novel mechanism can compensate the 
usual decrease of the Dingle factor below the upper critical magnetic field caused by the intralayer 
scattering. 
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In recent years it has been questioned whether the elec- 
tronic properties of layered quasi-two-dimensional (2D) 
metals can be described within the usual fundamental 
concept of an anisotropic three-dimensional Fermi liq- 
uid [lj. Well-studied examples, besides the cuprate su- 
perconductors and quasi-one-dimensional organic met- 
als, are organic conductors of the type (BEDT-TTF^A, 
where BEDT-TTF stands for bisethylenedithio-tetra- 
thiafulvalene and X for a monovalent anion. This class 
of materials displays a number of unique properties such 
as an unconventional electronic interlayer transport, clear 
deviations of their magnetic quantum oscillations 2] from 
the standard three-dimensional (3D) Lifshitz-Kosevich 
theory [3, and puzzling features in the superconducting 
mixed state. After the first observation of the de Haas- 
van Alphen (dHvA) oscillations in the mixed state of a 
layered superconductor |4| it was firmly established that 
these oscillations are damped below the upper critical 
field B C 2- This damping was explained by several mecha- 
nisms reviewed in |5| . A recent observation that both the 
dHvA and the Shubnikov-de Haas (SdH) amplitudes are 
enhanced in the mixed state of the layered organic super- 
conductor /3"-(BEDT-TTF) 2 SF 5 CH 2 CF2S03 (/3" salt in 
the following) 6§ was a real surprise since it is in sharp 
contrast to all experiments and theories known so far 5] . 

Theoretically, it is assumed that the quasiparticle scat- 
tering by the "vortex matter" just below the upper crit- 
ical field, B C 2, is the main mechanism of the damping 
in this region yielding the Dingle-like additional damp- 
ing factor R s — exp(— 2h/Q,t s ). Here, is the cy- 
clotron frequency and h/r s is the sum of the two terms 
H/t s i = A 2 (7r/uM7) 1/ ' 2 , due to the intralayer scattering 
at vortices 0>S@) an d h/r S 2 = /3A 2 //i^It 0i which takes 
into account the scattering by impurities and vortices 
within the layers is the scattering time, fi is 

the chemical potential, A is the superconducting order 
parameter which just below J3 C 2 is less than the Landau- 
level separation A < Ml, and (3 ~ 1.) 

The additional factor R s describes the extra damp- 



ing of the dHvA and SdH amplitudes only due to the 
intralayer scattering in 2D conductors. Within this con- 
cept, however, the oscillation-amplitude enhancement in 
the P" salt is not explicable. Anomalous dHvA oscil- 
lations have also been observed in YM2B2C 0, fl2| . 
These oscillations persist down to the surprisingly low 
field 0.2B C 2 01 • A Landau-quantization scheme for fields 
well below B r o i n the periodic vortex-lattice state was 
developed in |l3| and for a model with an exponential 
decrease of the pairing matrix elements in [lOj . The ob- 
served recovery of the dHvA amplitudes for B <C B C 2 
in YNI2B2C was explained by the enhancement of the 
special vortex-lattice factor depending on the Landau 
bands which become narrower when the vortex-lattice 
grows thinner |lfj| . 

The anomalous magnetic quantum oscillations in the 
mixed state of the (3" salt is much more mysterious and 
poses the question on the peculiarity of this material. 
The P" salt is the only among the known supercon- 
ductors which (i) displays enhanced magnetic quantum- 
oscillation amplitudes in the mixed state and (ii) has 
no 3D Fermi surface (FS), i.e., exhibits an incoherent 
electronic transport across the layers |l4|. The incoher- 
ence means that the electronic properties of this layered 
quasi-2D metal cannot be described within the usual fun- 
damental concept of an anisotropic 3D FS. Nonetheless, 
magnetic oscillations due to the 2D FS survive Q] . 

Here, we consider a new mechanism for the quasipar- 
ticle scattering that goes beyond the usual 2D consid- 
eration of miralayer scattering by taking into account 
the mferlayer-hopping contribution to the total scatter- 
ing rate. This can explain an oscillation-amplitude en- 
hancement in the superconducting state for layered con- 
ductors with incoherent hopping across the layers. The 
clear physical picture behind this mechanism is as fol- 
lows. The incoherence, or disorder in the direction per- 
pendicular to the layers, hampers the electron hopping 
between neighboring layers. This enhances the scattering 
at impurities within the layers since electrons on a Lan- 
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dau orbit interact with the same impurities many times 
before a hopping to the neighboring layer occurs. In the 
superconducting state long-range order establishes across 
the layers which allows quasiparticles to escape the in- 
tralayer multiple scattering by Josephson tunneling be- 
tween the layers. This mechanism reduces the scattering 
rate by impurities and enhances the Dingle factor in the 
superconducting state. For the (3" salt this effect most 
likely plays the dominant role. For the coherent case, 
there is no interlayer scattering and the electrons (quasi- 
particles) can move freely across the layers both in the 
normal and the superconducting state which render the 
above mechanism much less effective. Numerically, the 
effect is described by the layer- stacking factor [Eq. 
which itself contains a Dingle-like exponent in the case 
of incoherent interlayer hopping |l5j . Superconductivity 
restores the coherence across the layers by renormalizing 
the hopping integrals This reduces the interlayer 

scattering and enhances the oscillation amplitudes. 

In case the momentum across the layers is not pre- 
served, the electron interlayer hopping maybe described 
in terms of an energy e that is distributed with the den- 
sity of states (DOS) g(s). The energy spectrum of a 
layered conductor in a perpendicular magnetic field is, 
therefore, given by E n {e) = Ml(n + 1/2) + e .15]. The 
total DOS then follows from the standard Green-function 
definition 
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where E n (£) is the average self energy corresponding to 
the nth Landau level and I = (he/cB) 1 / 2 is the magnetic 
length. For large energies and large n w E/hVt 3> 1 (rele- 
vant for the magnetic quantum oscillations here) the self 
energy is independent on the index n and the summation 
in Eq. by use of Poisson's formula yields 

(2) 

where iV(0) is the 2D electron-gas DOS and the func- 
tion Rd(p, E) = exp (— 2irp\lmS>(E) \ / ft£i) generalizes the 
Dingle factor to the case of an energy-dependent self en- 
ergy X(-E). The layer-stacking factor in Eq. (J2J), 
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is an important factor in the theory of magnetic quan- 
tum oscillations in normal and superconducting layered 
systems nana. It describes contributions to the oscilla- 
tions coming from the interlayer hopping. If the stacking 
is irregular I p becomes complex and contains a Dingle- 
like exponent [lfij . 

The inverse scattering time 1/t(E) = \lmH(E)\/H 
in the self-consistent Born approximation (SCBA) was 



found to be proportional to the total DOS [li l ITU . I20I] . 

Accordingly, the relation N(E)/N(0) = tJt{E) holds, 
where r is the intralayer scattering time |2ll |22( . Sub- 
stituting this into Eq. J3J) leads to an equation for t(E) 
showing that it oscillates as a function of 1/B. 

In case the highly anisotropic electronic system has 
a 3D Fermi surface the DOS related to the interlayer 
hopping is symmetric, g(e) = g(—e), and becomes for 
nearest-neighbor hopping g{e) — 7r _1 (4i 2 — e 2 ) -1 / 2 . The 
corresponding layer-stacking factor then is given by I p — 
Jo(47rfp / Ml) . This Bessel function oscillates as a func- 
tion of 1 /B which is just another way to describe the well- 
known bottle-neck and belly oscillations of a corrugated 
3D FS. Oscillating corrections to the Ginzburg-Landau 
expansion coefficients caused by the factor J (A-ntp/Ml) 
were also calculated in |23| . 

For the incoherent case, on the other hand, the trans- 
lation invariance across the layers is lost. The irregular 
interlayer hopping means that the DOS deviates from 
the function 17(e) = 7r _1 (4t 2 — e 2 ) -1 / 2 and loses the sym- 
metry g(e) — g(—£) which implies that ImJ p ^ 0. As 
will be shown below, this results in a special contribu- 
tion to the electron scattering time. Below B C 2, this may 
lead to a suppression of the scattering rate acting against 
the known intralayer damping mechanisms of the quan- 
tum oscillations in the mixed state However, this 
contribution vanishes if the hopping between the layers 
preserves the interlayer momentum leading to a corru- 
gated 3D FS cylinder. This is an important point in our 
consideration. 

Using Eq. © and N(E)/N(0) = t /t{E) we write 
t(E)^ 1 as a sum of the coherent (symmetric) and inco- 
herent (asymmetric) terms: 



r^-^r^)" 



r(E)l 



(4) 



^ = l + 2^(-l)Pi? D ( JJ , J B)Re/ p cos('^") , (5) 
p— 1 ^ ' 



2jr(-iyRv( P ,E)ImI pS m (^) . (6) 
p=i ^ ' 



With the help of the summation rule 



S(X,S)= (-l) p e- |p|A cos P (5 = 



sinh A 



cosh A + cos 5 



(7) 



one can rewrite Eqs. J5J and JfJJ in the integral form 

— = - [ deg s{a) (e)S[X,S(E,e)}. (8) 

T„(a) To J 

Here g a (e) = g a {—e) is the symmetric and g a {e) = 
—g a (—e) is the antisymmetric part of the DOS g(e), 
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X(E) = 2-K/nr, and S(E,e) = 2n(E-e)/Ml. The SCBA, 
as well as Eqs. (@J-(|HJ), are valid not only for point-like 
impurities but also for a smooth random potential pro- 
vided its correlation radius is less than the Larmor ra- 
dius, which holds for large n j^jj. One can see from 
Eqs. JlJl-lJHJl that, in general, the incoherent contribu- 
tion, — t(E)~ 1 , to the total scattering rate, t(E)~ 1 , is 
essential. The integral equation for t(E)~ 1 is very com- 
plex and can be solved only perturbatively in the case 
A 3> 1. In the limit A — > oo, when 5(A, 5) — > 1, we have 
t^ 1 = Tq 1 and t^ 1 = 0. For finite, but large A the 
parameter Rv(p,E) = e~ pX <C 1. Even if fir ~ 1, the 
quantity e~ x <C 1 and Eqs. © and JJJJ are just a series 
expansion in powers of the small parameter e _A . Eq. l(7)l 
shows the convergence of this series for any A > al- 
lowing a perturbative solution. The perturbative terms 
oscillate as a function of E and can be written as the 
series ^(E) = r^ x [l + X 1 + X 2 + 0(e- 3A °)], with 
Xi oc e~ Xo ,X 2 oc e" 2A °, and A = 2n/riT . The first 
nonzero correction averaged over an oscillation period is 



proportional to X\ + X 2 



-2A e- 2A °|ii| 2 and yields 
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The Dingle factor i?^ = exp (— 27r/f2To) is a small pa- 
rameter in our perturbative solution. The term ImJ 2 in 
Eq. appears due to the incoherence. 

It was established that in the j3" salt electron hopping 
across the layers is most probably incoherent, i.e., the 
momentum perpendicular to the layers is not preserved 
and there is no 3D Fermi surface [hjj. The reason for 
this remarkable feature is unknown so far. It might be 
that some kind of disorder, such as different spatial con- 
figurations in the extraordinary large and complex anion- 
molecule layer may induce random hopping integrals, in 
analogy with intercalated layered compounds 15]. Fur- 
thermore, the /3" salt is the only material so far studied 
(not only among the BEDT-TTF salts) which displays an 
enhancement of the magnetic quantum-oscillation ampli- 
tude in the superconducting state |(J. 

This important result is summarized in Fig. ^ In this 
Dingle plot for a 2D metal the amplitudes Ai of the fun- 
damental dHvA frequency (F « 198 T) and A 2 of the 
second harmonic (2F) are normalized by Bsinh(X)T _1 
and plotted on a logarithmic scale as a function of 1/-B, 
with X = 2w 2 fcsTOcT / ehB and m c the effective cyclotron 
mass (see for more details). Upon entering the su- 
perconducting state the oscillation amplitude A\ is en- 
hanced compared to the normal-state dependence (solid 
lines). For the second harmonic A 2 neither an additional 
damping nor an enhancement is observed [2^] . 

In the superconducting state long-range order across 
the layers evolves through the renormalization of the 
hopping integrals This can be understood as fol- 

lows. The quasiparticle hopping between the layers is 
an independent degree of freedom with respect to the 




FIG. 1: Dingle plot of the fundamental {A\) and the second 
harmonic (A2) dHvA amplitudes of the 0' salt extracted from 
modulation-field data for different temperatures. The solid 
lines are fits to the data above 6 T. 



in-plane Landau quantization. In the normal state the 
Green-function equation related to the interlayer hopping 
is given by 



E 



[(e - ei)5 im - t im }GlAe) = 5, L 



(10) 



where the electron energy in the layer e% and the hopping 
integrals t, m = fi(<5j, m +i +5j. m -i) are assumed to depend 
on the layer indices for the sake of generality. In the 
superconducting state the order parameters in the layers, 
Ai, become nonzero and the Gor'kov equation for the 
Green functions Gu can be written as 1 1(1 



[(£ - Si)8i m - ti m ]Gij(e) = 5. 



tim. ti: 



AiG im (—e)Am 



(11) 



(12) 



The star means the complex conjugate. When compar- 
ing Eq. (fTU)l with Eq. ((TIT) it is seen that i n the supercon- 
ducting state the effective hopping integrals, given by Eq. 
(|12f) . become nonzero not only for next-nearest-neighbor 
hopping. In that case the nonvanishing retarded Green- 
function components G° m (— e) result in nonzero ti m for 
electron hopping between arbitrary sites i and m. In 
fact, Eq. (|T2Tl simply reflects how the superconducting 
long-range order establishes across the layers. The com- 
plex order parameters in the layers A, = | Aj | exp (iip) 
appear and result in interlayer (intrinsic) Josephson cou- 
pling 0] . In the absence of Josephson currents the order 
parameter can be chosen to be real and independent of 
the layer index Aj = |Aj|. The correction to the DOS 
due to this mechanism is 



5g{e) 



dg{e) 
dt.j 



GU-e). 



(13) 
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The second effect we have to take into account is 
caused by the vortex matter in the mixed state. Here, the 
vortices are disordered for fields slightly below B c2 . They 
convert the degenerated Landau levels into asymmetric 
Landau bands as was shown in Kefs. [2^, |2g. Thus, 
in the mixed state the quasiparticlc tunneling between 
the layers implies the quantum transition between these 
Landau-band states which results in the additional con- 
tribution to the simple nearest-neighbor DOS 



6g A (s) = A 



2 ( dg(e) 



\ <9A 2 



(14) 



A=0 



The total correction to the DOS in the mixed state can 
be written as 5g to t(£) — A 2 G(e), where G(e) is directly 
defined by Eqs. lfP3)) and l|14[l. Inserting Sg to t(s) into Eq. 
ifSjl and averaging over a period in E results in 



1\ A 2 f A 2 

- = — / deG( £ )5(A, 6(E, -e)) = —7. 



(15) 



Since the DOS is normalized (J deg(e) — 1) the function 
G(e) satisfies the condition J dsG(e) = 0. This means 
that it is alternating in sign and 7 might be negative 
because S(\,S(E,—e)) > 0. The studied system is too 
complex to calculate 7 in general. In the limit A — > 00 
this coefficient vanishes since S(X,6(E,—e)) — > 1. It is 
instructive to consider a correction to the scattering rate 
in Eq. (JjJJ in the mixed state. The variation of the layer- 
stacking factor Six is given by Eq. © with the DOS 
replaced by <5<?tot(e)- The broadening of the Landau lev- 
els, caused by 6g to t(s), is of the order of the width of this 
function and much less then HQ in order to observe the 
oscillations. Therefore, in first approximation Re<57i « 
and ImSh = A 2 J deG(e) sin(^) « A 2 (2z^p), where 
(e) = J dsG(s)e. (For G(e) = — G(— e), ReSIi is zero ex- 
actly.) Thus, the correction to the scattering rate in the 
mixed state near B C 2, caused by the interlayer-hopping 
mechanism, is given by 



, 21m/! 

TO 



7^ ) « 2 

ilTo 



Ml 



(16) 



For (e) Im/i > 0, this gives a decrease in the scattering 
rate. Note that the latter is nonzero only if the system 
is incoherent in the normal state and Im/i ^ 0. This 
strongly supports the relevance of this mechanism for the 
(3" salt, since only this organic metal displays both inco- 
herence in the normal state and an enhancement of the 
SdH and dHvA amplitudes in the mixed state. 

Thus, the overall effect superconductivity has on R s 
is determined by the balance between positive and neg- 
ative contributions to the scattering rate. The already 
mentioned positive contribution from the intralayer scat- 
tering at vortices and defects is 



/ \ 1/2 
— ) 

\fj,m J 



(17) 



The new additional interlayer mechanism we discuss here 
results in a negative contribution given by S (^) = ^-7 
[Ea. lfT3|) ]. Since little is known about the DOS of the 
studied system, even in the normal state, we cannot cal- 
culate the coefficient 7 quantitatively. However, contrary 
to Eq. I|17|l. for this term the small factor l//i is absent, 
so that the overall correction to the scattering rate might 
be negative. The experimental facts Q give us confidence 
that this is the case at least for the /3" salt. 

We conclude with a qualitative picture of the effect 
discussed here. The incoherence means that the hopping 
time between the layers t z « 7i/|f| ;§> To so that an elec- 
tron scatters many times within a layer before leaving 
it 0. Here the quantity \t\ is some averaged hopping 
integral that in the j3" salt may be assumed to be the 
smallest parameter in energy. Indeed, experimentally \t\ 
cannot be resolved in the (3" salt reflecting the fact that 
the hopping integral is one of the smallest for all known 
2D organic metals so far 0|. Consequently, even small 
spatial fluctuations of the hopping probability within and 
across the layers render the electron motion across the 
layers incoherent. On the other hand, for the evolution of 
superconductivity some interlayer (Josephson) coupling 
is vitally important. Long-range order establishes below 
B C 2, thereby renormalizing the hopping integral. Accord- 
ing to Eq. I|12|l . the renormalized t z in the superconduct- 
ing state may be estimated as t z « H/\t + A 2 /<|. For 
A 3> \t\ the hopping time reduces considerably and be- 
comes t z w h\t\/A 2 . The latter means that the quasipar- 
ticles spend less time within the (impurity-containing) 
layers decreasing the scattering rate and, consequently, 
enhancing the Dingle factor. In the j3" salt this effect is 
strong because of the smallness of \t\. Thus, our mech- 
anism relates the two unusual effects observed in the (3" 
salt: the incoherent interlayer hopping transport and the 
enhancement in the quantum-oscillation amplitudes in 
the mixed state. 
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